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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S. C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)IEI Responsive to communication(s) filed on 07 April 2005 . 
2a)D This action is FINAL. 2b)E3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) H3 Claim(s) 2-30.33-61 and 64-99 is/are pending in the application. 

4a) Of the above claim(s) 3. 5. 10-12, 16-20. 23. 25-26. 34. 36. 41-43. 47-51. 54. 56-57. 65. 67. 72-74. 78-82. 85. 
87 and 88 is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) See Continuation Sheet is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
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1.0 Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
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Application No. 09/823,763 



Continuation of Disposition of Claims: Claims rejected are 2,4,6-9,13-15,21,22,24,27-30,33,35,37-40,44-46,52,53,55,58- 
61,64,66,68-71,75-77,83,84,86 and 89-99. 
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DETAILED ACTION 
Response to Amendment 

1. The amendment and written response filed on 04/07/2005 has been entered and 
considered. 

2. Claims 1, 31, 32, 62 and 63 have been cancelled. 

3. Claims 2, 21, 33, 52, 64 and 83 have been amended. 

4. Claims 94-99 have been added. 

5. Claims 3, 5, 10-12, 16-20, 23, 25-26, 34, 36, 41-43, 47-51, 54, 56-57, 65, 67, 72-74, 78- 
82, 85, 87 and 88 have been withdrawn from consideration. 

6. Claims 2-30, 33-61 , 64-99 are pending. 

Response to Arguments 

7. Claims 1-2, 4, 6-9, 13-15, 21-22, 24, 27-29, 31-33, 35, 37-40, 44-46, 52-53, 55, 58-60, 
62-64, 66, 68-71, 75-77, 83-84, 86, 89-91 and 93 were rejected under 35 U.S.C. 102(e) as being 
anticipated by Roy et al (EP 1139269 A2). Applicant argues the instant applicant has an earlier 
effective filing date than the Roy reference (EP 1139269 A2). The examiner notes the Roy 
reference (EP 1 139269 A2) has a corresponding US application No. 09/538,209, now US Patent 
No. 6,956,569 Bl, which has an earlier effective filing date of 03/30/2000. Now the rejection in 
this office action is made in view of Roy et al, (U.S. Patent No. 6,956,569 Bl). 

Claim Rejections - 35 (JSC §102 
The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 351(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

8. Claims 2, 4, 6-9, 13-15, 21-22, 24, 27-29, 33, 35, 37-40, 44-46, 52-53, 55, 58-60, 64, 66, 
68-71, 75-77, 83-84, 86, 89-91, 93, 95-96 and 99 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Roy et al (U.S. Patent No. 6,956,569 Bl). 

a. Referring to Claim 2, Roy discloses a registration means for obtaining an 
registering 3-D data of all or part of one or more registered objects (Roy at 
column 17, lines 50-54, teaches the invention is implemented in computer 
language C or C++, and the means of the invention will be modules as explained 
at column 10, lines 18-40. 37 3D models are the claimed "3-D data", which is 
obtained and stored/registered in a pilot database, and such 3-D models are 
registered objects of "human faces" see figure 1); and a comparison means for 
obtaining 2-D data of a target object and comparing the obtained 2-D data with 
the data registered in the registration means for conducting judgment concerning 
the similarity/sameness between the target object and each of the one or more 
registered objects (2-D photographed query of a person's face as shown in figure 
1, column 6, lines 5-26, is obtained and matched to a 3-D model to measure the 
mutual information between the 3-D model and the 2-D query, column 6, lines 1- 
4; note the claimed "target object" in Roy is a person's face; mutual information is 
the claimed "similarity/sameness"), wherein the comparison means includes: a 
photographing means for photographing the target object and thereby obtaining an 
input image (the 2-D query is photographed by a camera, column 6, lines 39-49 
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and column 9, lines 13-19; a position/pose determination means for determining 
the position/pose of the target object in the input image obtained by the 
photographing means (column 6, lines 5-26 5 the pose of the target object, a 
person's face, is determined, column 10, lines 34-40, pose module); an 
illumination correction means for generating an image of each registered object in 
the same position/pose as the target object in the input image and under an 
illumination condition most similar to that of the input image as a reference image 
by use of the position/pose determined by the position/pose determination means 
and the data registered in the registration means (column 6, lines 5-26, using the 
input 2-D query to determine the lighting condition, the claimed "illumination 
condition" and render a picture for each model under the same lighting conditions 
as the 2-D query, column 6, lines 39-48, step b. The rendered picture of each 
model is the claimed "reference image", column 10, lines 34-40, lightsphere 60); 
an image comparison means for comparing each reference image generated by the 
illumination correction means with the input image obtained by the photographing 
means and thereby calculating an evaluation value concerning the similarity 
between the two images column 6, lines 39-48, step dl, the evaluation value is the 
likelihood value, column 10, lines 53-67 and column 11, lines 1-11, rendering 
module 170); and a judgment means for judging whether or not each of the 
registered objects registered in the registration means is the same as or similar to 
the target object photographed by the photographing means based on the 
evaluation calculated by P the image comparison means (column 6, lines 39-48, 
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whether a model is the correct one is determined, and the determining 
step/module is the claimed "judgment means"). 

b. Referring to Claim 4, Roy discloses a 3-D shape measurement means for 
measuring the 3-D shapes of all or part of the one or more registered objects (the 
R, N, L and b of each model are measured, column 7, lines 16-29); a 
color/intensity measurement means for photographing the registered object and 
thereby obtaining information concerning color or intensity of the registered 
object (column 7, lines 33-35, image intensity of each model is obtained); and a 
data storage means for storing the 3-D shapes measured by the 3-D shape 
measurement means and the color/intensity information obtained by the 
color/intensity measurement means as the registered data (a memory storage is 
inherently incorporated in a computer stored the data). 

c. Referring to Claim 6, Roy discloses an image generation means for generating 
images of each registered object in the same position/pose as the target object in 
the input image and under various illumination conditions as illumination 
variation images by use of the position/pose estimated by the position/pose 
determination means and the data registered in the registration means (surface 
normals, surface images of each 3-D models, are generated upon determination of 
the object pose/position in the 2-D query, column 7, lines 10-15, and the surface 
normals are the claimed "images" generated by image generation means); and an 
illumination condition estimation means for generating an image that is the most 
similar to the input image obtained by the photographing means by the image 
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generation means and outputting the generated image to the image comparison 
means as the reference image (through measure of errors, column 7, lines 10-15, a 
picture that is closest to the 2-D query is rendered, column 7, lines 63-67, column 
8, lines 1-28). 

d. Referring to Claim 7, Roy discloses the illumination correction means further 
includes an illumination variation image space generation means for generating an 
illumination variation image space which is spanned by the illumination variation 
images generated by the image generation means; and the illumination condition 
estimation means generates the image that is the most similar to the input image 
from the illumination variation image space generated by the illumination 
variation image space generation means and outputs the generated image to the 
image comparison means as the reference image (A(n) in equation 22 is the 
claimed "illumination variation image space"). 

e. Referring to Claim 8, Roy discloses the illumination variation image space 
generation means generates basis vectors of a space that almost accommodates 
image variation due to the illumination variation by conducting principal 
component analysis to the illumination variation images generated by the image 
generation means (a surface normal is created for each subpart of 3-D model, 
column 12, lines 27-30); and the illumination condition estimation means obtains 
inner product between the input image obtained by the photographing means and 
each of the basis vectors generated by the illumination variation image space 
generation means, generates the image that is the most similar to the input image 
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by use of the basis vectors and based on the inner products, and outputs the 
generated image to the image comparison means as the reference image (column 
13, lines 41-43, n is the claimed "basis vectors" and see equation 34 for inner 
product I(p)). 

f. Referring to Claim 9, Roy discloses wherein the illumination correction means 
further includes an illumination condition variation means for setting various 
illumination conditions and outputting the illumination conditions to the image 
generation means (column 10, lines 41-52, the lighsphere module 60 is the 
claimed "illumination condition variation means", and outputs lightings from 
directions). 

g. Referring to Claim 13, Roy discloses wherein the position/pose determination 
means outputs a predetermined position/pose to the illumination correction means 
(pose module 120 outputs a predetermined pose to the lightsphere module 60, 
column 10, lines 53-67, column 11, lines 1-11). 

h. Referring to Claim 14, Roy discloses wherein the position/pose determination 
means receives inputs concerning position/pose from the outside, and outputs the 
received position/pose the illumination correction means (the pose module 120 
receives the pose information from the input 2-D query, and outputs the 
information to lightsphere module 60). 

i. Referring to Claim 15, see explanation in Claim 14. 

j. With regard to Claim 21, see explanation in Claim 2 and 4, and also see column 7, 
lines 16-29, for reflectance R on each point of the 3-D model. 
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k. With regard to Claim 22, see explanation in Claim 8. 

1. Referring to Claim 24, Roy discloses wherein the 3-D shape measurement means 
obtains the 3-D shapes by reading data or drawings (Roy teaches the 3-D shapes 
are obtained through scanning device 20, column 10, lines 18-33). 

m. With regard to Claim 27, see explanation in Claim 24. 

n. With regard to Claim 28, see explanation in Claim 2. 

o. With regard to Claim 29, Roy discloses wherein the judgment means searches for 
one or more registered objects that are similar to the target object (column 10, 
lines 53-67, column 11, lines 1-11). 

p. With regard to Claim 33, see explanation of Claim 2. 

q. With regard to Claim 35, see explanation of Claim 4. 

r. With regard to Claim 37,see explanation of Claim 6. 

s. With regard to Claim 38, see explanation of Claim 7. 

t. With regard to Claim 39,see explanation of Claim 8. 

u. With regard to Claim 40, see explanation of Claim 9. 

v. With regard to Claim 44, see explanation of Claim 13. 

w. With regard to Claim 45, see explanation of Claim 14. 

x. With regard to Claim 46, see explanation of Claim 1 5. 

y. With regard to Claim 52, see explanation of Claim 21 . 

z. With regard to Claim 53, see explanation of Claim 22. 

aa. With regard to Claim 55, see explanation of Claim 24. 

bb. With regard to Claim 56, see explanation of Claim 25. 
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cc. With regard to Claim 58 5 see explanation of Claim 27. 
dd. With regard to Claim 59, see explanation of Claim 28. 
ee. With regard to Claim 60, see explanation of Claim 29. 

ff. With regard to Claim 64, the only difference between Claim 64 and Claim 2 is 
Claim 64 calls for additional limitation of "a machine readable record medium 
storing one or more programs, which Roy teaches because Roy implements his 
invention on a computer system, which inherently contains a machine readable 
record medium storing one or more programs. 

gg. With regard to Claim 66, see explanation in Claim 4. 

hh. With regard to Claim 69, see explanation of Claim 7. 

ii. With regard to Claim 70, see explanation of Claim 8. 

jj. With regard to Claim 71, see explanation of Claim 9. 

kk. With regard to Claim 75, see explanation of Claim 13. 

11. With regard to Claim 76, see explanation of Claim 14. 

mm. With regard to Claim 77, see explanation of Claim 15. 

nn. With regard to Claim 83, see explanation of Claim 21 . 

oo. With regard to Claim 84, see explanation of Claim 22. 

pp. With regard to Claim 86, see explanation of Claim 24. 

qq. With regard to Claim 89, see explanation of Claim 27. 

rr. With regard to Claim 90, see explanation of Claim 28. 

ss. With regard to Claim 91, see explanation of Claim 29. 
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tt. Referring to Claim 93, Roy discloses wherein the registered objects are human 

faces (column 10, lines 18-33). 
uu. With regard to Claim 95, see explanation of Claim 27. 
w. With regard to Claim 96, see explanation of Claim 29. 
ww. With regard to Claim 99, see explanation of Claim 93. 
Claim Rejections - 35 USC § 103 
The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 30, 61, 92, 94, 97, and 98 are rejected under 35 U.S.C. 103(a) as being 

unpatentable over Roy et al. The arguments in Paragraph 8 as to the applicability of Roy are 

incorporated herein. 

a. Referring to Claim 30, Roy does not explicitly disclose the registered objects are 
automobiles, however, Roy teaches his invention is applicable to numerous and 
various types of objects to be recognized, not limited to only human faces. A 
person of ordinary skill in the art would have been motivated to modify Roy's 
system for automobiles because the process of Roy's system to perform 
automobile recognition is the same as facial recognition, the only slight 
modification would be replacing the models stored in the database. 

b. With regard to Claim 61, see explanation in Claim 30. 

c. With regard to Claim 92, see explanation in Claim 30. 
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d. With regard to Claim 94, see explanation in Claim 30. 

e. With regard to Claim 97, see explanation in Claim 30. 

f. With regard to Claim 98, see explanation in Claim 30. 

Conclusion 

10. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Tom Y. Lu whose telephone number is (571) 272-7393. The 
examiner can normally be reached on 8:30AM-5PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571)-272-7695. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-2 1 7-9 1 97 (toll-free). 



